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Abstract 

The use of proper orthogonal decomposition (POD) to explore the complex fluid flows that are common in 
engineering applications is increasing and has yielded new physical insights. However, for most engineering 
systems the dimension of the dynamics is expected to be very large yet the flow field data is available 
only for a finite time. In this context, it is important to establish the convergence of the POD in order to 
accurately estimate such quantities as the Karhunen-Loeve dimension. Using direct numerical simulations of 
Rayleigh-Benard convection in a finite cylindrical geometry we explore a regime exhibiting extensive chaos 
and demonstrate the consequences of performing a POD with a finite amount of data. In particular, we 
show that the convergence in time of the eigenvalue spectrum, the eigenfunctions, and the dimension are 
very slow in comparison with the time scale of the convection rolls and that the errors incurred by not using 
the asymptotic values can be significant. We compute the dimension using two approaches, the method 
of snapshots and a Fourier method that exploits the azimuthal symmetry. We find that the convergence 
rate of the Fourier method is vastly improved over the method of snapshots. The dimension is found to be 
extensive as the system size is increased and for a dimension measurement that captures 90% of the variance 
in the data the Karhunen-Loeve dimension is about 20 times larger than the Lyapunov dimension. 



1. Introduction 

Many open challenges remain in the development 
of ways to describe, model, and predict chaotic fluid 
flows [l|. One method proposed by Lumley Q to 
study turbulence is to use a Karhunen-Loeve de- 
composition, or proper orthogonal decomposition 
(POD), to decompose the flow into an optimal set 
of basis functions. This has lead to many discover- 
ies and has increased our understanding of turbu- 
lence including the dynamics of streaks and burst- 
ing events @, |, i, ffllS & M, EL the dynamics 
of energy transfer [12 | . Il3l| . and the mechanism of 
drag reduction [II. Il5|. Recently, this has been 
extended to many experimental and numerical in- 
vestigations of more complicated flow fields in engi- 
neering applications that are quite different than a 
typical theoretical investigation of fluid turbulence 
(c.f. [l6|, II3|)- An important difference is that the 
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interval of time over which the data is available is 
often very short. This limiting factor is present in 
both experimental and numerical studies. It is an- 
ticipated that the dimension describing the dynam- 
ics of these systems is very large and as a result the 
short time observations provide only a limited sam- 
ple of the overall dynamics. 

We explore this by quantifying the convergence 
of the Karhunen-Loeve dimension with time for a 
high-dimensional fluid flow field. Our results pro- 
vide insights for the use of POD for more complex 
engineering flow fields where only a finite amount 
of data is available. Our results show that (i) the 
eigenvalue spectrum, the eigenfunctions, and the di- 
mension for the POD of a complex flow field can be 
approximated from finite time observations; and (ii) 
tailoring the numerical algorithm to exploit the ro- 
tational invariance in the problem vastly improves 
the rate of convergence. 

We show this by numerically integrating the 
time-dependent and three-dimensional Boussinesq 
equations that govern the fluid motion of Rayleigh- 
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Benard convection in a shallow cylindrical domain. 
In particular, we explore the spatiotemporal chaos 
of the fluid convection rolls that arise when a layer 
of fluid is heated uniformly from below in a gravi- 
tational field. A typical flow field pattern from our 
numerical simulations is shown in Fig. [1] which il- 
lustrates a horizontal mid-plane slice of the domain 
where red is hot rising fluid and blue is cool falling 
fluid. 

The dimension of the attractor describing the dy- 
namics of chaotic convection is expected to be much 
lower than one would find in fully developed turbu- 
lent flow P, [3, [l9j]. However, the dimension of 
convection is large enough to test these ideas fl9j |. 
Our results provide quantitative estimates for the 
convergence rates and magnitudes of important di- 
agnostics that result from a POD study. 




Figure 1: (color) A typical pattern of convection rolls from a 
numerical simulation of chaotic Rayleigh-Benard convection 
in a shallow cylindrical domain. The flow field is shown at 
mid-depth z = 1/2 where red indicates warm rising fluid and 
blue indicates cool falling fluid. For this simulation Y = 10, 
R/R c = 3.5, and <j = 1. 



2. Numerical Methods 

2.1. Direct Numerical Simulation 

The fluid motion of Rayleigh-Benard convection 
is governed by the Boussinesq equations 

a' 1 (d t + u V)u = -VP + V 2 u + RTz, (1) 
(<9t + u-V)T = V 2 T, (2) 
V-u = 0, (3) 



which represent the conservation of momentum, en- 
ergy, and mass. In our notation dt is a time deriva- 
tive, z is a unit vector in the direction opposing 
gravity, u is the fluid velocity, p is the pressure, 
and T is the temperature. The equations are nondi- 
mensionalized using the layer depth al as the length 
scale, the vertical diffusion time of heat t„ = d 2 /a 
for the time scale where a is the thermal diffusiv- 
ity, and the constant temperature difference AT be- 
tween the bottom and top plates as the tempera- 
ture scale. In our investigation we consider a shal- 
low cylindrical convection domain of radius ro and 
depth d. On all material walls we impose the no-slip 
boundary condition 



u = 0. 



(4) 



The top and bottom plates are held at a constant 
temperature T(z = 0) = 1 and T(z = 1) = and 
the lateral sidewalls of the domain are perfectly con- 
ducting boundaries with 



T = 1 



(5) 



There are three important nondimensional param- 
eters that completely describe the dynamics. The 
aspect ratio of the domain 



r "7 



(0) 



which is a measure of the system size and ro is the 
radius of the domain. The Prandtl number 

o = ~ (7) 

a 

where v is the kinematic viscosity, and the Rayleigh 
number 

R ^l^ ( 8 ) 

CtV 

where g is the acceleration due to gravity and /3 is 
the coefficient of thermal expansion. 

The control par ameter that is varied in most ex- 
periments is R [20| . For no-slip boundaries the crit- 
ical value of the Rayleigh number is R c = 1708 
which corresponds to the onset of convection rolls. 
For a fluid with <j « 1, as R is increased R < 10 4 
the steady convection rolls are replaced by pat- 
terns of rolls with time dependent dynamics that 
include periodic, qu asip eriodic, and chaotic dynam- 
ics (c.f. [IE [II [11 III)- As R is increased further 
R > 10 5 the convection rolls are annihilated and 
replaced by thermal plume structures yielding tur- 
bulent convection [l[. In this paper we are inter- 
ested in the range where the patterns of convec- 
tion rolls exhibit spatiotemporal chaos and we use 



R = 6000 (which yields R/R c = 3.5), a = 1 and a 
range of system sizes 6 < T < 15. In the following 
we solve the time-dependent Boussinesq equations 
using a geometrically flexible, efficient, spectral el- 
ement algorithm [23, H^, [27| • Further details on 
the specific application of this numerical method to 
thermal convection can be found in Ref. [28|. 

2.2. Proper Orthogonal Decomposition 

The POD of a fluid flow field can be cast as the 
solution of the Fredholm integral, 

/ K"(x,x')*(x')dV = ^(x), (9) 
in 

where, 

A'(x,x')= lim - / u(x,t) <g)u(x',t)dt, (10) 

and <8> is an outer product, f2 is the volume of the 
entire domain, x is the position vector, 3>(x) is 
the eigenvector with associated eigenvalue /i, and 
K(x, x') is the kernel. The kernel is built using the 
two-point correlation of the fluctuating space-time 
velocity components u(x, t) averaged over time t. 
The Karhunen-Loeve dimension Dk l is the number 
of eigenmodes necessary to capture a given fraction 
/ of the total variance of the data 

Dkl 

12 m 

i S^ = / (11) 

12 h 

j=i 

where a typical choice is / = 0.9. The observation 
time r should be long enough such that most of the 
dynamics on the attractor have been observed. In 
the limit r — > 00 this is satisfied. However, for a 
finite amount of data it is desired that the data is 
sufficient for the dimension to have converged to a 
value close to its asymptotic value such that Dkl ~ 

Doo. 

For the Rayleigh-Benard convection studied here 
we perform a POD on the two-dimensional flow field 
pattern at the mid plane as shown in Fig. [T] The 
reason for this is two-fold. One, a typical experi- 
ment using shadowgraphy to measure the convec- 
tive roll pattern would generate the same type of 
data. Second, it is expected that the convection 
rolls do not contain structure in the vertical direc- 
tion that would have a significant impact upon the 



dimension. In collecting data for our POD we use 
images from the flow field separated in time by 5r„ 
where the total duration of the numerical simula- 
tion depends upon the system size explored. 

2.2.1. Fourier Method 

The size of the eigenvalue problem to solve the 
Fredholm integral in Eq. ((9j is large. Two methods 
that are used to reduce the computations are the 
Fourier method and the method of snapshots. 

For a rotationally invariant system every rotation 
of the solution is also valid. The coefficients of the 
POD in the azimuthal direction are therefore those 
of a Fourier series [2i| . When this invariance is built 
into the computational procedure we refer to this 
as the Fourier method. Therefore, the eigenmode 
for mode m, 

* m (r,9) = *Ur)e in6 (12) 

is uniquely described with an azimuthal wavenum- 
ber n and eigen number q. This reduces the com- 
putation of the Karhunen-Loeve modes to 

/ rC n (r,r')^ n (r'ydr' =^ n (r), (13) 
Jo 

where, 

K n {r,r') = lim - / u„(r,i) ® u* n (r',t)dt, (14) 

r^oo T J Q 

with ★ denoting the complex conjugate and the 
weight r' is present because the inner product 
is evaluated in polar-cylindrical coordinates (r, 9) . 
The Fourier transform of the velocity in the az- 
imuthal direction is u„(r, t). The kernel in Eq. (| 13[) 
is Hermitian as it was in Eq. @ and yields real and 
positive eigenvalues. Using a Q-point quadrature 
to solve Eq. (fT3| yields 3Q eigenvectors and corre- 
sponding eigenvalues in descending order for each 
azimuthal mode n, denoted with eigen number q. 
Physically, each eigenvector (r)e represents a 
velocity field and the eigenvalue /i^ is the time av- 
eraged energy of that flow field. 

2.2.2. Method of Snapshots 

The method of snapshots recasts the eigenfunc- 
tion in the Fredholm integral in Eq. (|9|) as a linear 
combination of the snapshots where 

c(i)= / u(x',i)*(x')tfV (15) 




Figure 2: (color) Four flow fields from numerical simulation 
that are separated in time by 50i\, for T = 10, R/R c = 3.5, 
<r = 1. The values of Dkl computed using the Fourier 
method for each individual flow field are 46.1, 46.8, 49.8, 
and 48.5 for panels (a)-(d) respectively. 

and Eq. © is then 

lim - [ u(-K,t)c(t)dt = A*(x). (16) 

T^OO T J Q 

Multiplying both sides by u(x, t') and integrating 
yields, 

lim - / c(t) / u(x, t')u(x, t)d 3 xdt = Xc(t') 

(17) 

or, 

1 r 

lim- / (u(x,t'),u(x,t))c(i)dt = Ac(i') (18) 

where ( , ) denotes an inner product over the do- 
main CI. The resulting equation is now a Fredholm 
integral in time. In fluid dynamics this is more com- 
putationally tractable because there are typically 
fewer time observations (snapshots) than there are 
spatial observations (grid points). 

3. Discussion 

3.1. Comparison of the method of snapshots and 
the Fourier method 

We now illustrate the differences between the 
two methods through two examples using numer- 
ical data from our simulations for T = 10. The 



Table 1: The cumulative Karhunen-Loeve dimension of the 
four flow field images shown in Fig. [2] The number of images 
used in computing the dimension is n for both the method 
of snapshots and the Fourier method. 



Samples 


Snapshots 


Fourier 


n 


Dkl 


Dkl 


1 


0.9 


46.1 


2 


1.79 


84.2 


3 


2.64 


118.3 


4 


3.49 


147.4 



50 




Figure 3: (color) The cumulative dimension of a flow field 
pattern where a single snapshot is rotated azimuthally by 
increments of A8 = 27r/512 to form new snapshots where 
the angle of rotation is 9i = iA8 and i is an integer. Results 
are shown for a total of 1024 rotations where method of 
snapshots is the solid line and the Fourier method is the 
dashed line. The two methods agree when i = 512 and 1024 
corresponding to one and two complete rotations of the flow 
field, respectively. The flow field used is at time t = 500 (see 
inset) and for the simulation parameters T = 10, a = 1, and 
R/Rc = 3.5. 

flow field patterns from four instances in time sep- 
arated by 50t v are shown in Fig. [2l Using the 
Fourier method the dimensions of these individ- 
ual images are Dkl — 46.1, 46.8, 49.8, 48.5 for pan- 
els (a)-(d), respectively. We next construct a time 
series out of these images and compute the dimen- 
sion using images from panels (a), (a,b), (a,b,c), 
and (a,b,c,d) which we refer to as the cumulative 
dimension in Table [T] The magnitude of the dimen- 
sion increases rapidly with the addition of each new 
flow field image. When using all four images the 
Fourier method yields a dimension of Dk l = 147.4 



which is less than the sum of the individual contri- 
butions 191.2. 

The method of snapshots, which does not take 
advantage of the rotational invariance of the flow 
field, has only a dimension of 3.49 when using all 
four images. This comparison illustrates the rapid 
convergence of the Fourier method for the compu- 
tation of Dkl in high-dimensional systems. 

Using the same convection domain with Y = 10 
we now consider a single flow field image from time 
t = 500 that is rotated azimuthally in small incre- 
ments to create a series of images that is then used 
to compute Dkl- The specific flow field pattern 
that is used is shown in the inset of Fig. [3] The 
image is rotated incrementally by A6* = 27r/512 to 
yield rotations of 9 = iA9 where i = 1,2,..., 1024 
resulting in two complete rotations. 

The values of Dkl from the method of snapshots 
and the Fourier method are shown in Fig. [3] The 
dimension from the Fourier method is Dkl — 47.3 
using only one image and remains at this value for 
the subsequent incremental rotations. The method 
of snapshots however, increases monotonically for 
each incremental rotation and agrees with the di- 
mension from the Fourier method only after one 
complete rotation. This occurs for subsequent com- 
plete rotations as well. 

This example illustrates the clear computational 
advantage, in terms of rate of convergence, of the 
Fourier method for computing Dkl- It also shows 
that both the method of snapshots and the Fourier 
method eventually yield the same value for Dkl- 
The computed values of Dkl only agree after the 
flow field pattern has undergone a complete rota- 
tion. For the case of actual flow field data it is 
expected that the two approaches would also agree 
if enough data were used for the method of snap- 
shots to sample from all of the possible orientations. 
However, this can be a very slow process as we will 
demonstrate. 

3.2. The Lyapunov and Karhunen-Loeve dimen- 
sions 

A significant advantage of studying chaotic 
Rayleigh-Benard convection is that the spectrum of 
Lyapunov exponents have been calculated to yield 
quantitative measurements of the Lyapunov dimen- 
sion The spectrum of Lyapunov exponents 
Xj measure the exponential separation of trajecto- 
ries in phase space and are ordered from largest to 
smallest. A single positive exponent is the defining 
feature of deterministic chaos (c.f. [H, OmI HH ) . The 



sum of the first N exponents indicates the expo- 
nential growth of an N— dimensional ball of initial 
conditions in phase space. The number of expo- 
nents that must be added in order for their sum 
to equal zero yields the Lyapunov dimension. Us- 
ing a linear interpolation to find the precise value 
of this number is the commonly used Kaplan- Yorke 
formula 13211 . 



D X = J 



Sj 



|A./+i| 

where J is the largest j for which 



(19) 



(20) 



The Lyapunov dimension D\ is an approximation 
to the number of degrees of freedom that contribute 
to the chaotic dynamics [33|, IH • 

The Karhunen-Loeve dimension was compared 
with the Lyapunov dimension by Sirovich and 
Deane 34j as the Rayleigh number was varied for 
turbulent Rayleigh-Benard convection in a small 
periodic domain with free surface boundary con- 
ditions. Zoldi et al. [HI computed Dkl from ex- 
perimental shadowgraph images of the spiral defect 
chaos state 36| of Rayleigh-Benard convection in a 
large cylindrical domain with T = 109. In order to 
explore the variation of Dkl with the system size 
the data was spatially sampled with a window of in- 
creasing size. Using this approach it was found that 
Dkl scaled linearly with window size demonstrat- 
ing extensivity. For Rayleigh-Benard convection in 
a shallow layer there are effectively two spatially ex- 
tended directions and, as a result, the system size 
is measured as T 2 . 

The spiral defect chaos state has also been ex- 
plored numerically. Using a range of large peri- 
odic box geometries D\ was found to scale ex- 
tensively with system size for T = 48,56,64 and 
R/R c = 1.8 [3]. For box geometries the aspect ra- 
tio is defined as V = L/d where L is the length of an 
entire side of the box. The dimension D\ m 80 for 
the largest domain and the dimension density was 
found to be 5\ = D x /T 2 w 0.019. The extensiv- 
ity of chaos was also shown numerically for a range 
of finite cylindrical geometries for 4.72 < V < 15, 
(7=1, and R/R c — 3.5 [lj|. In this case the di- 
mension density was found to be 6\ « 0.25. In 
our study we have chosen to explore the same sys- 
tem parameters as those of Ref. [19] and to compute 
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Figure 4: The convergence of the normalized eigenvalue spec- 
trum as a function of time r for T = 6 where the time has 
been normalized by the horizontal diffusion time r^. The 
error is given by E v for the method of snapshots (dashed 
line) and the Fourier method (solid line). 

the variation of Dk l over the same range of system 
sizes. 

3.3. Convergence of the eigenvalues and eigen] func- 
tions 

We next examine the convergence of the normal- 
ized eigenvalue distribution 

m = (2i) 

i 

where the index i is over all computed eigenvalues 
fii. The variation of magnitude of the error with 
time E v (t) is computed as, 

^(r) = l-M (22) 

I '/i.OQ I 

where \rji\ is the magnitude of the eigenvalue spec- 
trum and |??i,oo | is the value using the largest r avail- 
able for each case. The error E v decreases rapidly 
with time and is shown in Fig. 0] The time has 
been normalized by the nondimensional time re- 
quired for heat to diffuse a distance r$ which we 
refer to as the horizontal diffusion time Th = T 2 . 
The nondimensional time scale of the fluid motion 
in a convection roll is on the order of r w 1 and Th 
represents a long-time scale. The convergence rate 
of the Fourier method is again found to be faster 
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Figure 5: The convergence of the eigenfunctions with time 
for a convection domain with aspect ratio T = 6. The error 
in the eigenfunction for mode i is given by E% j. Results 
are shown for i = 1 (solid lines), i = 25 (dashed lines), and 
i = 50 (dash-dotted lines). The results computed using the 
method of snapshots are represented by thin lines and those 
using the Fourier method are represented by thick lines. 
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Figure 6: The variation of Dxl with time for the Fourier 
method (*) and the method of snapshots (o) for V = 
6. The converged value for the Fourier method is given 
by the dash-dotted line. The curve fit for the method 
of snapshots is D KL = 137.8 - 68.4exp (-0.0730t/t ;i ) - 
69.3 exp (— 0.00406t/i7j) and is given by the dashed line. The 
asymptotic value of the dimension for the method of snap- 
shots is given by the solid line at = 137.8. 

than the method of snapshots. For t w 5rh the 
error is E v ~ 10 -2 using the method of snapshots 
and E n ~ 1CP 4 using the Fourier method. 



The convergence of the POD modes depend upon 
their eigenvalue and Fig.[5]shows the convergence of 
modes 1, 25, and 50. Again we use the data for the 
largest available r as an approximation for r — > oo. 
The time variation of the magnitude of the error for 
the ith mode is computed as 

g*.i(r) = l- ( ^ (T) '?'-° o) . (23) 

Again, the Fourier method converges faster than 
the method of snapshots. 



Table 2: The variation of the dimension with system size. 
The asymptotic values of the Karhunen-Loeve dimension 
-Doo are given for the method of snapshots and the Fourier 
method. The Lyapunov dimension D\ computed for the 
same system parameters are included from Ref. [19| . 





Snapshots 


Fourier Method 


Lyapunov 


r 


Dkl 


Dkl 


D x 


6 


138 


142 


6.8 


10 


265 


409 


21.6 


12 


632 


570 


32.5 


15 


1320 


1045 


53.7 



3.4- The convergence of the Karhunen-Loeve di- 
mension 

The convergence of Dkl for T = 6 with respect 
to time is shown in Fig. [SJ where the time has 
been scaled by the horizontal diffusion time Th ■ Re- 
sults are given for both the Fourier method and 
the method of snapshots. The Fourier method has 
reached a value of Dkl ~ 142 after r « 20^. 

On the other hand, the method of snapshots ex- 
hibits a very gradual convergence. The numerical 
simulations were continued until r w 60r^. In or- 
der to estimate a value of the asymptotic value of 
the dimension D^ for the method of snapshots the 
results are fit with the following exponential depen- 
dence, 

T T 

D K l(t) = Doo + ci exp (-C2— ) + c 3 exp (-c 4 — ) 

Th T h 

(24) 

which is shown as the dashed line. The fitted curve 
is used to determine the asymptotic value of the di- 
mension to yield Doo = 137.8 and is indicated by 
the solid line. The convergence is very slow. For the 
dimension to converge within 10% of Doo requires 
a time of r ~ 400t^. Such a slow convergence rate 
in time is typical of our results for the method of 
snapshots. A further difficulty resulting from the 
slow convergence is the that the value of Doo is 
very sensitive to small variations in the data that is 
made more significant when only a finite amount of 
data is available. The variation of Dkl with time 
is shown for T = 10, 12, 15 in Figs. [3(5] respectively 
and numerical values of the Dkl are given in Ta- 
ble [2] 

3. 5. Extensivity 

Figure [TO] shows the time variation of the cumu- 
lative normalized energy of the first TV eigenvalues. 




Figure 7: The variation of Dkl with time r for the Fourier 
method (*) and the method of snapshots (o) for V = 10. 
The converged value for the Fourier method is given by 
the dash-dotted line. The curve fit for the method of 
snapshots is D kl (t) = 265.2 - 82.0 exp (-0.2455r/r h ) - 
194.8exp (— 0.02796t/t/,) and is given by the dashed line. 
The asymptotic value of the dimension for the method of 
snapshots is given by the solid line at Doo = 265.2. 



The normalized energy is computed from, 



E n (t) 



N 

fc=0 

oo 

fe=0 



(25) 



using the data from the Fourier method with the 
largest r for each respective system size. The ba- 
sic trend of Em{t) shows that the total number of 
modes N needed to capture a fraction / increases 
with system size. Figure [TT] shows the variation of 
Dkl with system size using different values of / 
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Figure 8: The variation of Dkl with time r for the Fourier 
method (*) and the method of snapshots (o) for T = 12. 
The converged value for the Fourier method is given by 
the dash-dotted line. The curve fit for the method of 
snapshots is D kl (t) = 632.2 - 130.6cxp (-0.1444r/r h ) - 
504.2 exp (— 0.01404t/t>,) and is given by the dashed line. 
The asymptotic value of the dimension for the method of 
snapshots is given by the solid line at Doo = 632.2. 
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Figure 9: The variation of %j, with time r for the Fourier 
method (*) and the method of snapshots (o) for T = 15. 
The converged value for the Fourier method is given by 
the dash-dotted line. The curve fit for the method of 
snapshots is D kl (t) = 1320.1 - 36.5 exp (-0.7892T/r h ) - 
1290.3 exp (— 0.01908t/t;>) and is given by the dashed line. 
The asymptotic value of the dimension for the method of 
snapshots is given by the solid line at Doo = 1320.1. 

where 0.5 < ,f < 0.95. Our results yield a linear 
relationship between Dkl and T 2 over the entire 
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Figure 10: The fraction of the total energy captured Ejv 
as a function of the number of modes N using the Fourier 
method. Results are shown for T = 6 (solid line), T = 10 
(dashed line), T = 12 (dash-dotted line), and T = 15 (dotted 
line). A typical approach used to compute the value of Dkl 
is to use the number of modes needed for Eff = 0.9. From 
these results it is clear that Dkl increases in value as the 
system size is increased. 
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Figure 11: The variation of the dimension Dkl with system 
size T 2 for several choices of / using the Fourier method. 
Results are shown for / = 0.5 (circles), / = 0.8 (triangles), 
/ = 0.9 (squares), and / = 0.95 (stars). The solid lines are 
linear curve fits through the data indicating the extensivity 
°f Dkl ■ in the following figures we have chosen to use / = 
0.9 when reporting values of Dkl- 

range. The choice for Dkl that we have used for 
reporting values of Dkl is / = 0.9. 

The variation of Dkl with system size is shown 
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Figure 12: The variation of Dkl and D\ with system size 
r 2 using numerical results for T = 6, 10, 12 and 15. The 
values of Dxl computed using the Fourier method are rep- 
resented as squares and the solid line is a linear curve fit. 
The value of Dxl computed using the method of snapshots 
are represented as triangles and the dash-dot line is a linear 
curve fit. The Lyapunov dimension from Ref. [l9T | are rep- 
resented as circles and the dashed line is a linear curve fit. 
From the data Dkl ~ 19.7D\ where the Fourier method 
has been used for Dxl- 



We have performed a proper orthogonal decom- 
position on a finite cylindrical domain containing 
a shallow fluid layer undergoing extensively chaotic 
dynamics. Our results suggest that even for this 
case the required time necessary to obtain good es- 
timates of the Karhunen-Loeve dimension are very 
long and on the order of hundreds of horizontal 
diffusion times with the commonly used method 
of snapshots. However, by exploiting the rota- 
tional symmetry of the problem the time to conver- 
gence can be drastically reduced using the Fourier 
method. This has important consequences for more 
complex flow fields that are common in engineering 
applications where the amount of data available is 
limited in both experiment and for computations. 
A prime example is the use of particle image ve- 
locimetry to obtained detailed information about 
the flow field. In this case the observation time is 
a function of the amount of data that can be cap- 
tured by the camera. Overall, our results show that 
one must be careful to ensure the convergence of the 
proper orthogonal decomposition in order to obtain 
an accurate estimation of the dimension. 



in Fig. [T^] using the Fourier method (squares) and 
the method of snapshots (triangles) and linear curve 
fits through the data are given by the solid line and 
the dash-dotted line, respectively. The results using 
the method of snapshots increase with system size 
but with with significant deviations from the line of 
extensivity. As discussed, the rate of convergence 
for the method of snapshots is very slow and our 
numerical results would need to be continued for 
much longer simulation times for these results to 
converge. However, if this were done the results 
would eventually agree with those of the Fourier 
method which is extensive. 

The variation of D\ with system size is shown in 
Fig. [T3 by the circles with a linear curve fit given 
by the dashed line. Although there is no reason 
to expect the two dimensions to be related since 
they measure very different aspects of the patterns 
and their dynamics, it has been suggested that for 
extensively chaotic dynamics their rate of increase 
should be similar 37|. Numerical values of the di- 
mensions are given in Table [H Using the linear 
curve fits through the data yields the relationship 
D KL » 19.7D A . 
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